A lexicographic cooperative co-evolutionary approach for feature selection
نویسندگان
چکیده
This paper starts with two hypotheses. The first one is that the simultaneous optimization of hyperparameters regulating classifier within a wrapper method, while best subset features being determined, should improve results respect to those obtained pre-parameterized classifier. second solving these problems can be formulated as lexicographic problem, allowing use simple single-objective evolutionary algorithm solve this multi-objective problem. fitness function key importance for such methods. It responsible guiding search towards potentially good solutions and it also consumes most runtime. Having issues in mind, proposes new function, designed minimize runtime avoid over-fitting. Furthermore, execution time quality by procedure depend on some algorithmic hyperparameters: similarity thresholds used when comparing different lexicographically percentage data samples validation during training process. Thus, an experimental analysis has been carried out find adequate values hyperparameters. Finally, cooperative co-evolutionary approach, using proposed paper, tested several datasets belonging University California, Irvine (UCI) repository real high-dimensional datasets, obtaining quite results, compared other state-of-the-art comparison made lexicographically, methodology paper.
منابع مشابه
A Classification Method for E-mail Spam Using a Hybrid Approach for Feature Selection Optimization
Spam is an unwanted email that is harmful to communications around the world. Spam leads to a growing problem in a personal email, so it would be essential to detect it. Machine learning is very useful to solve this problem as it shows good results in order to learn all the requisite patterns for classification due to its adaptive existence. Nonetheless, in spam detection, there are a large num...
متن کاملEvolutionary Feature Selection for Big Data Classification: A MapReduce Approach
Nowadays, many disciplines have to deal with big datasets that additionally involve a high number of features. Feature selection methods aim at eliminating noisy, redundant, or irrelevant features that may deteriorate the classification performance. However, traditionalmethods lack enough scalability to copewith datasets ofmillions of instances and extract successful results in a delimited time...
متن کاملAn Evolutionary Approach to Feature Set Selection
This paper investigates an ensemble feature selection algorithm that is based on genetic algorithms. The task of ensemble feature selection is harder than traditional feature selection in that one not only needs to find features germane to the learning task and learning algorithm, but one also needs to find a set of feature subsets that will promote disagreement among the ensemble’s classifiers...
متن کاملFeature Selection for High Dimensional Data: An Evolutionary Filter Approach
Problem statement: Feature selection is a task of crucial importance for the application of machine learning in various domains. In addition, the recent increase of data dimensionality poses a severe challenge to many existing feature selection approaches with respect to efficiency and effectiveness. As an example, genetic algorithm is an effective search algorithm that lends itself directly to...
متن کاملAn Evolutionary Approach for Feature Selection applied to ADMET Prediction
Feature selection methods look for the selection of a subset of features or variables in a data set, such that these features are the most relevant for predicting a target value. In chemoinformatics context, the determination of the most significant set of descriptors is of great importance due to their contribution for improving ADMET prediction models. In this paper, an evolutionary-based app...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2021
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2021.08.003